ON ESTIMATION OF REGULARITY FOR GAUSSIAN PROCESSES 

DELPHINE BLANKE AND CELINE VIAL 

Abstract. We consider a real Gaussian process X with unknown smoothness r where 
r is a nonncgative integer and the mean-square derivative X^ ^ is supposed to be locally 
stationary of index /3 . From n + 1 equidistant observations, we propose and study an 
estimator of (r ,/3 ) based on results for quadratic variations of the underlying process. 
Various numerical studies of these estimators derive their properties for finite sample size 
and different types of processes, and are also completed by two examples of application to 
real data. 



1. Introduction 



For a real stationary and non differentiable Gaussian process with covariance K(s,t) = 
K(\t - s\ ,0) such that K(t, 0) = K(0,0) - A \t\ m> + o(|t| 2/3 °) as \t\ -> 0, the parameter /3 , 
< j3 < 1, is closely related to the fractal di mensio n of th e sa mple paths. This re l ation- 
ship is developed in particular in the works of lAdlerl ( 119811 ) and iTaylor and Taylor! ( 119911 ) 
and it ga ye rise to an importan t liter at ure around the estima tion of n . We refer i n par - 
ticular to Const ant ine and Hall! (Il994h . Ilstas and Larigl (ll997f ) and iKent and Woodl (Il997h 
for estimators based on quadratic varia tions and their extensions. Still in this stationary 
Gaussian framework. IChan et al.l ( 119951 ) introduce a periodogram-type estimator whereas 
Feuerverger et al. (Il994f ) use the number of level crossings. 

In this paper, our aim consists in the estimation of the couple (r ,/3 ) when the Gaussian 
process is supposed to be r -times differentiable with a locally stationary r -th derivative of 
regularity O . Thus, we generalise the previous works in two ways: 

(1) the process has an unknown regularity r to be estimated as well as the smoothness 

ft, 

(2) the process is not supposed to be stationary not even with stationary increments. 



Our m ethodol ogy is based both on the estimator of r , say f , proposed by lBlanke and Vial 
(120 ll[ ) and on IKent and Woodl ( 119971 ) for the estimation of O . we give a new result con- 
cerning the mean square error of fg as well as almost sure rates of convergence of the global 
regularity index H = 2{f Q + f3 ). As an application, we provide plugged-estimators, based 
on lagrange piecewise interpolation, which are optimal in rate, for the relative problems of 
integration and approximation of a discretised sample path. 
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2. Methodology 

2.1. Framework. Let X = {X(t), t G [0, T]} be a real Gaussian process observed at the 
(n + 1) equally spaced times i5 n , i = 0, . . . , n for some positive sequence 5 n such that 5 n — >■ 
and n<5 n — > T > 0. This process is supposed to satisfy the following assumptions. 

Assumption 2.1 (A I2.1I) . X has r , r G 1N 0; continuous derivatives in quadratic mean with 
X( r o) supposed to be locally stationary: 

, 2 



(2.1) lim sup 

h ~ >0 s,te[0,T],\s-t\<h,s^t 



E(X( r °)(s) -X^(t)) 
\s-t\^° 







where f3 g]0, 1[ and do is a positive continuous function on [0, T]. 

Here, local stationarity makes reference to Bermanl ( 1974f )'s meaning. Assumption A I2.1I 
implies in particular that the covariance function K(s,t) = Cov (X(s), X(t)) is also contin- 
uously differentiate with K^(s,t) = Cov (X^(s), X^{t)), for r = 0, ...,r„. Also, the 
mean of the process fi(t) := ~EX(t) is a r -times continuously different iable function with 
ElW(i) =/i (r) (^), r = 0,...,r . 

In this paper, we propose and study an estimator of the Holder regularity index H = 
2(r + /3 ), say H . To this aim, we need the following additional condition: 

Assumption 2.2 (J$£2Xj>)). For either p = 1 orp = 2, K^ r ° +p ' ro+p \s,t) exists on [0,T] 2 \{s = 
t} and satisfies for some D p > 0: 

\K (ro+p ' ro+p) (s,t)\ < D p \s-t\~ [2p - 2M . 

Moreover, we suppose that the mean /i(-) admits a continuous derivative of order (r + 1) on 
[0,71. 

2.2. Specific examples. A first important example of process meeting our conditions is 
the r -fold integrated fractional Brownian motion. For r = 0, X = Wp Q is the fractional 
Brownian motion (i.e. with covariance K(s, i) = |(s 2 ^ + 1 2/3 ° — \s — 1| 2/3 °)). For r > 1, we 
have 

X{t)= / / I ■■■ I W^ (u 1 )du 1 du 2 - ■■ du ro , r > 1 
Jo Jo Jo Jo 

One gets d (t) = 1, and for (3 ^\,D X = f3 Q |2/3 - 1| while D 2 = /3 12/3 - 1| . . . |2/3 - 3|. For 
special case of the Wiener process (/3 = |), we have K( ro+1,r ' 0+1 )(s, t) = on [0, l] 2 \{s = t}. 



Another examples of processes may be found among those satisfying the conditions of 
Sacks and Ylvisaker of order r (r > 0). For Q + = {(s,t) G]0, 1[ 2 : s > t} and f2_ = {(s,t) G 
]0,l[ 2 :s<t}: 

(a) K G C ro ' ro ([0, l] 2 ), on fi+ U L = K iro ' r ^ has partial derivatives up to order p, 
with either p = 1 or p = 2, continuous and continuously extendible to Q + and f2_ by 
continuity. 

(b) (s, s) — L+' ^(s, s) = a > 0, s G [0, 1] where Lj' is the extension of l/ 1 ' ) over 
[0, l] 2 , continuous on Qj and on [0, l] 2 \fij with j G {— , +}. 
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In this case, f3 = 1/2 with d (t) = a and these processes satisfy A I2.2( p) for p = 1,2. 

Another class of processes are stationary ones with spectral density tp such that: ip(\) = 
co(l + ciA 2 )~ 7 where 7 > \, Co > 0, c\ > 0. Then for 7 — ~ ^ IN, one gets r = [7 — ~] and 
/3 = 7 — I — r , and A I2.2( p). p = 1, 2 is satisfied at least for 7 G IN. A typical process is 
the Ornstein-Uhlenbeck one, with <p(\) = ±(6 2 + A 2 )" 1 and K(s t) = ( 26)- 1 exp(-6 \s - t\), 



so 7 



1, r n 



0, Pa = \ and d (t) = 1. Following lLasingerl ( 119931 ). one may construct 



stationary processes with r > 1 by r -fold repeated integration. 



Since all previous processes are stationary or with stationary increments, the function d 
is reduced to a constant. Of course, cases with non constant do(-) may be also obtained. In 
particular, we have processes with a smooth enough trend belong to our general class : 

Lemma 2.1. Let Y be a zero mean process with given regularity (r ,/3 ) and asymptotic 
function rf (t) = C r0j/ 3 . For a positive function a 6 C ro+P ([0, 1]) and m G C r ° +P ([0, 1]) 
(p = 1,2), if X{t) = a(t)Y(t) + m(t), then X has regularity (r ,/3 ) with asymptotical 
function D ro ^ {t) = a 2 (t)C r0t/ 3 and X satisfies A2.2l p). 

2.3. Estimation of O . iKent and Wood! fll997h and lConstantine and Hall (1l994f ) use "di- 
lation" quadratic variations to estimate the fractal index for stationary Gaussian process, not 
different iable in quadratic mean. Following this methodology, we define a global estimator 
of H = 2(r + f3 ) which is based on dilated quadratic variations and a consistent preliminary 
estimator of r . 

First for integers r, r such that f > r > 1 and u G N*, we consider the u-dilated quadratic 
variations of X of order r: 



n — ur 



(2.2) A { $X = J2 a i,rX((*u + k)5 n ), k = 0,... 

where order r of the sequence (aj jr ) means: 

r r r 

a i>r = 0, ai )T i T 7^ 0, and if r > 2, a^ r i p = for p = 1, . . . , r — 1. 



i=0 i=l 

Also, for r = r , r + 1, we assume that: 



i=l 



^2^2a i:r a j:r \i - j\ H ^ 0. 

i=0 j=0 

Note that, in the case where u = 1 and 8 n = n~ l , represents the classical finite 
difference of order r. A typical example of sequence (aj, r ) is given by a^ r = (p (— l) 1 * - - 7 , with 

r 

f = r, for which one obtains, in particular, Yl a j,rj r — r - Another examples are furnished 

j=0 

by Daubechies wavelets D[2p) of or der r = p with v anishing first moments of order to 
p — 1, and such that r + 1 = 2p (see iDaubechiesL Il992l ). 
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Asymptotic properties of X are important in the comprehension of our considered 

yj"r (A^X) 2 

estimators. From now on, we set: (A^X? = ^ k=0 K r ' k 1 with n r := n — ur. 

v ' n r + 1 

Proposition 2.1. Under Assumptions A2.1\ one obtains: 
(i) for r = r + l,r + 2: 



^E((A^X) 2 ) >u H £(r,r ,f3 ) 

1 7 u 1 f T 

where £(r, 0, (3 ) = — - a ir a^ r \i — j\ H — J do(t) dt while if r > 1, 



i,j=0 

-i r T 



ij'=0 

(ii) for r > 1 and r = 1, . . . ,r : 



(2 ' 3) £(r ' r °' 0o) = 2(2/3 + 2r ).-°(2/3 + l) £ ^ 



(2.4) 5- 2r E((A^X) 2 ) - 

ELojXr Vl f T ^( X ^(t)) 2 dt. 

r\ J T J 

Proposition 12. II implies that a good choice of r (r = r + l, r + 2) could provide an estimate 
of H, at least with an adequate combination of w-dilated quadratic variations of X. To this 
end, we propose a two steps procedure: 

• We consider the consistent estimate of r , say f~ derived in iBlanke and Viall ( 120111 ) 
and based on A^X : 

(2.5) f~ = min | r G {2,...,m n } : rT^A^X) 2 > 6 n | - 2. 

If the above set is empty, we fix fj, = l for an arbitrary value Iq G" 1N . Here, m n — > oo 
but if an upper bound B is known for r , one has to choose m n = B + 2. The threshold 
b n is a positive sequence chosen such that : n -2 * 1- ^ ^ — > and n 2 ^°b n — > oo for all 
0o G]0, 1[. For example, omnibus choices are given by b n = (lnn) a , a G R. 

• Next, we derive two family of estimators for H, namely Hn \ with either p = 1 or 



V 



In ( (A ( !»I) 2 | - In f (A ( 4 X) : 



ln(u/i;) 

where u,v (u < v) are given integers, chosen by the statistician. Then, two estimators 

y c 

= (£« - 2r )/2, p=l,2. 



/3 ^ of /3 can be directly derived: 
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(p) 



Remark 2.1. For r = fj, = 0, u = 1 and v = 2, J 3n corresponds to the ordinary least 

squares estimat o rs def ined in \ Constantine and Hall 1(1994) (with the choice p = 1 ) and 
Kent and Wood h99i ) (p = 2). Note that new estimators may be derived with other choices 
of(u,v) such as (u,v) = (1,4) which seems to perform well, see Section HOI 



In lBlanke and Viall (120111 ). an exponential bound is obtained for P(f^ ^ r ) implying that, 
almost surely for n large enough, f~ is equal to r . Here, we complete this result with a bound 
for the mean square error of f~ . 

Theorem 2.1. Under assumption A2.1\ and A2.2\( p). p = 1 or p = 2, we have 

E(r - r ) 2 = Ofmlexp ( - cp n (p)) 

where (p n (p) is defined by 

f , n( s \nt % M;)+n(\nn)-\t { U^ 
<Pn{P) = Ci(r ) x <^ ., _ Ui l2 ' 1 

\nijp — 2 

for some positive constant Ci(r ). 

Remark that one may choose m n tending to infinity as slowly as wanted. Indeed, the 
unique restriction is that r belongs to the grid {1, . . . ,m n } for large enough n. From a 
practical point of view, one may choose a preliminary fixed bound B, and, in the case where 
the estimator return the non-integer value Iq, replace B by B' greater than B. 



The bias of Hn will be controlled by a second-order condition of local stationarity, more 
specifically we have to strengthen the relation (12.11) in: 



(2.6) lim sup 

s,te[0,T],\s-t\<h,s^t 



^ r E(*M(.)-*W( t ))' 



s - 1 



2/3o 







for a positive /3 X and continuous function d\. 

Theorem 2.2. If relation (12. 6p and assumption A2.2V p) are satisfied, we obtain 



limsup^ - H 

n—too 

where C^ip) is some positive constant and 
VP 



< C 2 (p) a.s. 



n 

mm In" 

l/ Inn JU '4 



/IT 



v. 



2(l-/?o) 



Inn 14 



n 

" mn 
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Remark 2.2. Of course, since nS n 
terms of S n with: 



->• T > 0, the previous result can be expressed in 



-2(1-A)) 



V^=mm U-h, - 1 - 



3. Applications and numerical results 

All the numerical results are obtained on simulation of trajectories using two different 
methods : f or stationary processes or with stationary increments we use the procedure 
described in Wood and Chan (Il994l ) and for CARMA (continuous ARMA) processes, we 
Tsai and Chan ll200d l. Each of them consists in n equally spaced observation points on 



use 



[0, 1] and 1000 simulated sam ple paths. All computations have been performed with the R 
software (|R Core Team! 120121 ) . 



3.1. Simulation study : estimation of r . This section is dedicated to the numerical 



prope rties of two estimators of r . We consider the estimator introduced bvlBlanke and Vial 
(1201 ll ). defined in (I2.5p . Another estimator was introduced in lBlanke and Viall (120081 ) and is 



based on Lagrange interpolator polynomials, says r n . More precisely, for 8 n 
it is defined by 



mm 



r G {1, . . .,m n } 



1 

rn r 



rn r — l 

E 

k=0 



2k 



n 



X r 



2k + 1 



n 



) 2 >n 



n 



2ri 



et T 



1 



where n r 



2r 



and X r (s) is defined for all s G [0,1] and each r G {1, 



following way : there exist k — 0, 
interpolates of X(s) is defined by 



n r 



1 such that s G Xfc := [— 

d L n 



2kr 2(fc+l)r 
' n 



m n } in the 
and the 



X r(s) = ^L iAr {s)X 



2{kr 



n 



with La 



i.k.r \pj 



n 

3=0 



2(fcr+j)N 



■ 2(kr+i) 
n 



2(kr+j) - 
n 



Both estimators use a critical value depending on n, here we choose b n = 1/lnn, due to 
convergence properties. Table 13.11 illustrates the strong convergence of both estimators and 
shows that this convergence is valid even for small number of observation points n, up to 
10 for the estimator f~ . We may noticed that, for misspecified estimations our estimators 
overestimate the number of derivatives. Remark also that, for identical sample paths, f~ 
seems to be more robust than r n . This behaviour was expected as the latter uses only half of 
the observations for the detection of the jump in the quadratic mean. In these first results, 
processes have fractal index j3 equals to 1/2, but alternative choices of (3 are of interest, 
so we consider the fractional Brownian motion (in short fBm) and the integrated fractional 
Brownian motion (in short ifBm), with respectively f = and r~ = 1 and (3 g]0, 1[. Table 
13.21 shows that f~ succeeds in estimating the regularity r = even if the process is near 
regularity r = 1, of course the number of observations must be sufficient and even more 
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TABLE 3.1. Value of the empirical probability that r or r n equals r or r + 1 with 
n = 10 or 25. 





Wiener 


process, r () = 


CARMA(2,1), r = 1 


CARMA(3,1), r = 2 






Number of equally spaced observations n 




event 


10 


25 


10 


25 


10 


25 


f n = r 


0.995 


1.000 


0.913 


1.000 


0.585 


0.999 


r n = r„ + 1 


0.005 


0.000 


0.087 


0.000 


0.415 


0.001 


r = r 


1.000 


1.000 


1.000 


1.000 


0.999 


1.000 


f = r + l 


0.000 


0.000 


0.000 


0.000 


0.001 


0.000 



TABLE 3.2. Value of the empirical probability that r or r n equals r for a fractional 
Brownian motion or an integrated fractional Brownian motion of fractal index 2/3 . 





r = r 


r n = r 








number of equally spaced observations n 








50 


100 


500 


1000 


1200 


50 


100 


500 


1000 


1200 


ffim p 






















0.90 


1.000 


1.000 


1.000 


1.000 


1.000 


0.655 


0.970 


1.000 


1.000 


1.000 


0.95 


0.969 


0.999 


1.000 


1.000 


1.000 


0.002 


0.002 


0.004 


0.134 


0.331 


0.97 


0.242 


0.521 


1.000 


1.000 


1.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.98 


0.019 


0.015 


0.0420 


0.5258 


0.759 


0.000 


0.000 


0.000 


0.000 


0.000 


iffim (3 






















0.02 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


1.000 


0.90 


1.000 


1.000 


1.000 


1.000 


1.000 


0.000 


0.000 


0.645 


0.999 


1.000 


0.95 


0.305 


0.888 


1.000 


1.000 


1.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.97 


0.000 


0.000 


0.292 


0.993 


1.000 


0.000 


0.000 


0.000 


0.000 


0.000 



important for increasing values of r nd /?„. This latter result is clearly apparent when one 
compares the errors obtained for an iffim with /3 = 0.95 and a ffim with j3 = 0.95. Finally, 
we can see once more that r n is less robust against increasing (3 while it appears that, for 
n = 2000 and each simulated path, f~ is able to distinguish processes with regularity (0, 0.98) 
and (1,0.02), a quite indiscernible difference. 

3.2. Simulation study: estimation of H and /3 . This part is dedicated to the numerical 
properties of estimators Hn\ for p = 1 or 2 using the values u — 1 and v — 4 (giving a 
smaller variance than u — 1 and v — 2). It ends with real data examples. 

For the numerical part, we focus on the study of ffim, iffim and CARMA(3,1). Table 13731 
illustrates the performance of our estimators when /3 , r are increasing by computing the 
empirical mean-square error from our 1000 simulated sample paths and number of equally 
spaced observation n = 1000. It appears that, contrary to Hn \ the estimator slightly 
deteriorates for values of /3 greater than 0.8. This result is in agreement with the rate of 
convergence established in Theorem 12 . 21 which depends on /3 . The bias is negative and seems 
to be unsensitive to the value of r but the mean-square error is slightly deteriorated from 
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TABLE 3.3. Values of mean square error and bias (between brackets) for estimators H, 
for p — 1 or 2 and n = 1000. 





fflm /3 

0.2 0.5 0.8 0.9 0.95 


H (2) 


0017 0019 0034 0054 0065 

(-0.0020) (-0.0045) (-0.0120) (-0.0295) (-0.0448) 

0.0030 0.0039 0.0040 0.0039 0.0039 

(-0.0026) (-0.0038) (-0.0057) (-0.0069) (-0.0084) 




ifflm p 

0.2 0.5 0.8 0.9 0.95 


H (1) 

0(2) 
tin 


0.0032 0.0026 0.0041 0.0061 0.0073 

(-0.0072) (-0.0047) (-0.0150) (-0.0342) (-0.0488) 

0.0055 0.0051 0.0046 0.0044 0.0043 

(-0.0106) (-0.0060) (-0.0060) (-0.0061) (-0.0061) 



r = to r = 1 in both cases. Finally, for /3 < 0.8, H n ^ seems preferable to Hn \ possibly 
due to a lower variance of this estimator. Nevertheless, both estimators perform globally 
well on these numerical experiments. 



Results of Theorem 12.21 are also illustrated in Table 13.41 where we have computed the 
regression of ln(E|^ p) -H\) on Inn for various values of n and E|f/^ — H\ estimated from 
our 1000 simulated sample paths. As expected, the slope (corresponding to our arithmetical 
rate of decay) is constant and approximatively equal to 0.5 for while, for Hn , the 
decrease is apparent for high values of /3 . Finally, Figure 13.11 illustrates the behaviour of 
the estimators Hn with p = 1 or 2, for different values of the regularity parameter (3 . As 
we can see, boxplots are similar for both estimators when (3 = 0.5 or /3 = 0.8 but with a 
quite larger dispersion for H n 2 \ For (3 = 0.95, clearly outperforms from n = 500 
observations. Estimation appears more difficult for smaller values of n, but it is quite typical 
in our considered framework. 

Next, Table 13.51 illust rates the impact of est imating H when the order r in quadratic 
variation is misspecified. Kent and Wood! (119951 ). section 7, have already noticed that orders 
r > 1 are relevant for smooth processes. In fact estimating H requires the knowledge of 
r or an upper bound of it. On the other hand, working with a too high value of r may 
induce artificial variability in estimation, so a precise estimation of r is important. Here, 
our numerical results show that, if the order r of quadratic variation used for estimating H 
is less than r + 1, then the quantity estimated is 2r and not H. 

All previous examples are local stationary with a constant function d . Processes meeting 
our conditions but with no stationary increments may be constructed with Lemma 12.11 As 
an example, from Y a standard Wiener process (r = 0, /3 = 0.5) or an integrated one 
(r = 1, p o — 0.5), we simulate X(t) = (t r ° +0 - 7 + l)Y(t) having the regularity (r ,0.5), 
Figure 13721 illustrates a Wiener sample path and its transformation. Results are summarized 
in Table 13.61 Comparing with Table I3.3[ it appears that the estimation is only slightly 
damaged for r = 1 but of the same order when r = 0. Non- stationary processes may also 
be obtained by adding some smooth trend. To this aim, we used same sample paths as in 
Table 13.31 with the additional trend m(t) = (1 + t) 2 , see Figure 13.31 We may noticed in 



VTION 




100 250 500 750 1000 1250 

number of equally spaced observations points on [0,1] 




100 250 500 750 1000 1250 

number of equally spaced observations points on [0,1] 



* I | 



100 250 500 750 1000 1250 

number of equally spaced observations Doints on [0.11 




250 500 750 1000 1250 

lumber of equally spaced observations points on |0,11 




1 00 250 500 750 1 000 1 250 1 500 2000 
number of equally spaced observations points on [0,1] 




1 00 250 500 750 1000 1 250 1 500 2000 
number of equally spaced observations points on [0,1] 



(2) 



Figure 3.1. Each boxplot correspond to 1000 estimation of H by H n on the 
left and H n on the right of the graph. Each realization consists in n equally 
spaced observations on [0, 1] of a fBm with (3 = 0.5 (top), (3 = 0.8 (middle), 
f3 = 0.95 (bottom), where n = 100, 250, 500, 750, 1000, 1250, 1500, 2000. 

Table 13.71 that we obtain exactly the same results for the estimator H n and that a slight 
damage is observed for Hn\ 



Let us turn to examples b ased on real data sets. We first focus on roller height data 
introduced by iLaslettl (119941 ). which consists in n = 1150 heights meas ure at 1 micron 
intervals along a drum of a roller. This example was already studied in iKent and Wood 
( 19971 ). they noticed that local self similarity may hold at sufficiently fine scales, so the 
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TABLE 3.4. Rates of convergence illustrated by linear regression for n in 
{500,750, 1000,1250}. 





%?> 


tin 


slope .R^ 


slope i? 2 


fflm ft = 0.5 
ft = 0.6 
ft = 0.7 
ft = 0.8 
ft = 0.9 
ft = 0.95 


-0.488 0.998 
-0.475 0.998 
-0.426 0.994 
-0.334 0.989 
-0.225 0.990 
-0.186 0.995 


-0.489 0.995 
-0.488 0.995 
-0.489 0.997 
-0.491 0.997 
-0.495 0.997 
-0.503 0.997 


iffim ft = 0.9 
ft = 0.95 


-0.302 0.987 
-0.244 0.978 


-0.561 0.999 
-0.559 0.999 



TABLE 3.5. Mean value and standard deviation (between brackets) of the estima- 

(v) ^ ^ 

tor H n based on quadratic variation of order r or r — 1 instead of r + 1 or r + 2. 





Order r — 1 


Order r 


number n of e 
100 500 


quidistant observations 
100 500 


iffim ft = 0.2 

ft = 0.5 
ft = 0.8 




1.903 1.961 

(0.064) (0.025) 

1.955 1.992 

(0.035) (0.006) 

1.966 1.994 

(0.024) (0.004) 


CARMA(3,1) 


1.970 1.994 

(0.0140) (0.003) 


3.919 3.985 

(0.058) (0.0109) 



TABLE 3.6. Value of MSE and bias (between brackets) for non constant do(-). 





Wiener 


Integrated Wiener 




0.0021 

(-0.0032) 


0.0032 

(0.0061) 


H m 


0.0043 

(-0.0042) 


0.0058 

(-0.0091) 



TABLE 3.7. Value of MSE and bias (between brackets) for estimators H n , for 
p = 1 or 2 in presence of a smooth trend. 





ffim 

ft = 0.5 ft = 0.8 


iffim 

ft = 0.5 ft = 0.8 




0.0022 0.0283 

(0.0151) (0.1525) 


0.0027 0.0141 

(0.0083) (0.0863) 




0.0039 0.0040 

(-0.0038) (-0.0057) 


0.0051 0.0046 

(-0.0060) (-0.0060) 
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Figure 3.2. ffim with /3 = 0.5 (solid) and its transformation (dashed) used 
in Table EU 




Figure 3.3. Sample path of a ffim with /3 = 0.8 (dashed line) and the same 
with a trend m(t) = (1 + 1) 2 (solid line). 

Table 3.8. Estimates in the roller height example 



m 


H (1) 


"OLS 


H (2) 


"OLS 


2 


0.63 


0.63 


0.77 


0.77 


4 


0.50 


0.51 


0.63 


0.65 


6 


0.38 


0.39 


0.49 


0.51 


8 


0.35 


0.33 


0.44 


0.42 


10 


0.30 


0.28 


0.39 


0.35 



regularity r was supposed to be null. Indeed, our estimator f , directly used on the data 

with b n = l/log(n), gives f~ = 0, with a value of n 4 " 2 (A2 I) 2 = 1172345. Next, we compute 
the values obtained for the estimation of H by setting (u, v) = (1, m) i n our estimators, with 
m in | 2, 4, 6, 8, 10). In Table 13.81 v alues of estimates proposed by IConstantine and Hall 
( 1994[ ); Kent and Wood ( 1995 . 1997 ) are also reported for comparison. These estimates 
are obtained by considering ordinary least squares estimators Sqls (with p adapted to the 
regularity of the process, supposed to be known in their work). Note that, with Kent and 
Wood's notation, we have in this case H = 2(3 = a and for (u,v) = (1,2), one gets 



H, 



(i) 



(2) 



q-qls but H and a differ for other values of v. It should be observed 



that our estimators present a similar sensitivity to the choice of m, with perhaps a slightly 
greater robustness of our estimators against high values of m. 
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Table 3.9. Estimates in the biscuit example 





m = 2 


m = 4 


m = 6 


m = 8 


m = 10 


H {1} 

"OLS 


3.60 (0.12) 
3.60 (0.12) 


3.67 (0.07) 
3.67 (0.07) 


3.65 (0.05) 

3.66 (0.05) 


3.62 (0.04) 

3.63 (0.04) 


3.59 (0.04) 

3.60 (0.03) 


H (2) 

~(2) 


2.84 (0.45) 
2.84 (0.45) 


3.69 (0.30) 
3.67 (0.31) 


3.83 (0.24) 
i qi fn oi\ 


3.84 (0.19) 
q as fn 1 a\ 


3.83 (0.16) 
q aa fn 14) 




Figure 3.4. (a) Curve drawing reflectance in function of wavelength, varying 
between 1100 and 2498. (b) Box-plots drawing the results for both estimators 
on the right Hn^ on the left Hn for the 39 curves and (u,v) = (1,4). 



In order to compar e the (empiri c al) va riances of these estimators, we consider a second ex- 
ample introduced by lBrown et al.l ( 1200 ll ). The experiment involved varying the composition 
of biscuit dough pieces and data consist in near infrared reflectance (NIR) spectra for the 
same dough. The 40 curves are graphed on the figure 13.41 Each represents the near-infrared 
spectrum reflectance measure at each 2 na nometers from 1100 to 2498 nm, then 700 obser- 
vation points for each biscuit. According to iBrown et al.l ( 120011 ). the observation 23 appears 
as an outlier. We estimate r for each of the left 39 curves, using the threshold b n = 1, 

which gives F = 1 for each curve and an averaged mean quadratic variation n 2r ~ 2 (A^X) 2 
equal to 0.33 when r = 2 and 122133 when r = 3, this explosion leads us to the choice 
F — 3 — 2 — 1. We turn to estimation of H, to compare our estimators with Sq^s where 
p = 1 corresponds to the choice (1, —2, 1) for a^ r and p = 2 to the choice ( — 1, 3, —3, 1). The 
results are summarised in Table 13791 and it appears that, for order r~ + 2 = 3, our estimator 
seems to be less sensitive to the choice of m. To conclude this part, it should be noticed 
that for the 23rd curve, the choice m = 4 gives i?n = 3.64 and Hn^ = 3.55. It appears that, 
in both cases, these values belong to the interquartile range obtained from the 39 curves, so 
at least concerning the regularity, the curve 39 should not be considered as an outlier. 



3.3. Plug-in estimation : results and simulation. A classical and interesting topic 
is approximation and/or integration of a sampled path. An extensive lite rature may b e 
found on these topics with a detailed overview in the recent monog raph of iRitterl (l2000h . 
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The general framework is as follows : let X = {X t , t £ [0,1]}, be observed at sampled 
times to, n , ■ ■ ■ , tn,n over [a,b], more simply denoted by t ,...,t n . Approximation of X(-) 
consists in interpolation of the path on [a, b], while weighted integration is the calculus of 
X p = f X(t)p(t)dt for som e positi v e and continuous weight function p. These problems 
are closely linked, see e.g. iRitter fl2000h p. 19-21. Closely to our framework of local 
stationary derivativ es, we may refer more specifically to works of Plaskota et al.l ( 2004 ) for 
approximation and iBenhennil (119981 ) for integration. For sake of clarity, we give a brief 
summary of their obtained results. In the following, we denote by H(r , /3 ) the family 
of Gaussian processes having r derivatives in quadratic mean and r -th derivative with 
Holderian regularity of order /3 £]0, 1[. For measurable <7t(-), we consider the approximation 

^ 1 /2 

An,gtt) = J2 X ^9i( t ) and e p(An, g ) = ( E \X(t) - A n , g (t)\ 2 p(t) dt) will represent the 

i=0 

weigh ted and integrated L 2 -error. For X £ H(r , j3 ) and known (r ,j3 ), iPlaskota et < 
(120041 ) have shown that 

< c(r ,/3 ) < lim n r ° +/3 ° inf e p {A n , g ) < Em n ro+/3 ° inf e p (A rhg ) < C(r ,/3 ) < +oo 



for equidistant sampled times t±, . . . , t n and Gaussian processes defined and observed on the 
half-line [0, +oo[. Of course, optimal choices of functions gi, giving a minimal error, depend 
on the unknown covariance function of X. 

Concerning weighted integration, the quadrature is denoted by Q n ,d = ^r=o^(^)°^ with 
well-chosen constants di (typically, one may take di = f gi(t) dt). For known (r , /3 ), a short 
list of references could be: 



Sacks and Ylvisakerl (119681, 11970( 1 with r = or 1, f3 



Benhenni and Cambanis ( 19921 ) for arbitrary r and (3 Q 



Stein ( 19951) for stationary processes and r + /3 < 



l 

2' 



| and known covariance, 
i 

2' 



Ritterl (119961 ) for minimal error, under Sacks and Ylvisaker's conditions, and with 



arbitrary r . 



Let us set e„(Q 



n,d) 



ELL- Q 



n,d\ 



1/2 



the mean square error of integration. In the 

stationary case and for known r , Benhennil ( 1998 ) established the following exact behaviour: 
If p £ C ro+3 ([a,b]) then for some given quadrature Q n ,d*{r ) on [a, b], 



n 



ro+Po- 



[Qn 



) — > c r ,A,( / p 2 (t)i/> 



-(2(r +/3 )+l) 



where ib is t he density relative to the regular sampling {t\, . . . ,t n }. Moreover, following 
Ritterl (I1996h . it appears that this last result is optimal under Sacks and Ylvisaker's condi- 



tions. Finally, llstas and Laredo! ( 119971 ) have proposed a quadrature, requiring only an upper 
bound on r , with an error of order O(n~( r ° +I3o+ ^) . 



All these results shown the importance of well estimating r and motivate ourself to focus 
on plugged-in interpolators, namely those using Lagrange polynomial of order estimating by 
iv More precisely, for equidistant sampling ti = iS n , i = 0, . . . , n, S n — > 0, n5 n — > T > 0, 
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Lagrange interpolation of order r > 1 is defined by 

r r 

(3.1) X r (t) = J2 L iAr{t)X{{kr + i)5 n ), with L iAr {t) = f[ 

j=0 



i=0 



(t-(kr+j)5 n ) 

(i ~ j)Sn 



for t G Xu 



krS n , (k + l)rS n 



k = 0, 



L-J 

r 



2 and Zi 



L?J-i 



n 



L(-J 



Our plugged method will consist in the approximation given by *4 n ,L(£) = -X"max(r5,i)(0> 

t G [0, T], and quadrature by Q n ,L = J -Xfo- fcj (£) dt. Indeed, L agrange polynomials are 
of easy implementation and by the result of Plaskota et al. ( 20041 ). they reach the optimal 
rate of approximation, n~^ r ° + ^°> without requiring knowledge of covariance. Also we will 
show that the associate quadrature has the expected rate n~^ 0+ ^ 0+ ^ . For u nknown (r , /3 ), 
a first result of plugged approximation is derived in iBlanke and Viall (120111 ): if Assumption 
A I2.1I holds, we have for T — 1, p = 1 and some constant D(r ,f3 ): 

lim n 2{r ° + ^ f E(X(t) - A maxCr0il) (t)) 2 dt = D(r , ft). 

In the weighted case and for T > 0, we obtain the following asymptotic bounds. 

Theorem 3.1. Suppose that Assumption A2.1\ holds and consider a positive and continuous 
weight function p. 

(a) Under condition A2.2( l ), we have 



e /0 (app(f7 ) )) := 



E 



X(t) - X max(r0il) (t) pit) dt =o (c +/3 °) 



1/2 



(b) if condition A2~W2) holds: 



,(int(f^)) := 



E 



X(t)p(t) dt - / X fo+ i(t)p(t)dt 
o Jo 



1/2 



In conclusion, expected rates for approximation and integration are reached by plugged 
Lagrange piecewise polynomials. Of course if r is known, this last result holds true with f 
replaced by r . The figure 13.31 is obtained using 1000 simulated sample paths observed in 
equally spaced points on [0, 1]. This figure illustrates results of approximation for different 
processes. The logarithm of empirical integrated mean square error (in short IMSE), i.e. 
e i( a PP( r o)) is drawn in function of ln(n). We may notice that we obtain straight lines with 
slope very near to —H = — 2(r + j3 ). Since the Ornstein-Uhlenbeck process is a scaled 
time-transformed Wiener proces, intercepts are different contrary to stationary versus non 
stationary CARMA processes. 



4. Proofs of theoretical results 

4.1. Proof of Proposition [2TTT A. Let us begin with general expressions 
useful for the sequel. 
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4 5 6 7 

ln(n) 



Figure 3.5. Logarithm of ef (app(r^)), i.e. the IMSE in function of ln(n), 
for different type of processes. The dashed line correspond to Brownian mo- 
tion, long dashed line to O.U., dashed line to non stationary CARMA(2,1), 
dotted-dashed line to stationary CARMA(2,1) and solid line to non stationary 
CARMA(3,1). The small triangles near lines are here to indicate the theoretic 
slope. 



First for L^' p \s,t) = E(X^(s)X^(t)) (p > 0), the relation (EI]) is equivalent to 



(4.1) 



lim sup 

s,te[o,T\ 

\s-t\<h,s^t 



Is — t 



2/3 



d (t) 



0. 



We set k = k5 n , k iu = (k + iu)5 n , k iuv = (k + iuv)5 n , £ = £5 n , £j U = (£ + ju)5 n and 
(£ + juw)5 n . Next, from the definition of A^ X given in (I2.2p . we get 



^JUW 



i,j=0 



Case r = 0. As YH=o a *> r = 0, we have 



(4.2) E(AgxAgx) 



r r j - 



i=0 j=0 
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Case r > 1. We apply multiple Taylor series expansions with integral remainder. Next, the 
properties YH=o a i.ri p — for p — 0, . . . , r — 1 (and convention 0° = 1) induce : 

(4.3) E(A$ X) = 

VV r a i . r (u 2 zj(^) r * If - — V - r , ~7ttt^~ !L (r * ,r * ) (A; iw ,4-utu) dfdw 

Mo,i] 2 \\ r ~ L ) 1 ) 

where we have set r* = min(r ,r) > 1. 



B. From expressions f l4.2p -( l4~3l) . we now derive the asymptotic behaviour of E( (A r X( u )) 2 ). 
Case r > 1, r = r„ + 1 or r = r + 2. In this case, r* = r < r — 1. From (14. 3[) and the 
property ^i =0 a i,r^ r ° = 0, we may write 

(4.4) E(Ag Xf = £ a^Au^jSlr / / {1 ~ T~\^~\ ^^ k 

JJ[o,i} 2 U r o - 1 

— IL'- °' °\ki uv , ki uv ) 2^ °' °^^' mu > kjuw) di>du> 

|zw — jw\u6 n , we decompose E(A^j X) 2 into Si n (k) + 



ij=0 



Using the property 
S 2n (k) + S 3n (k) where 



h- — h ■ 



S\ n {k) = - ^ a itr a jtr (ij) ra (u5 n ) H [ / — ^77-^ ^] |iu - jw| 2/?0 do(fc) dt>du? 



S 2n {k) = - a i>r a jir (ij) ro (u6 n 

ij=0 



[0)1]2 2((r -l)!) 2 



|2t> — JU>| 



|^o(fci«tu) - ^o(^)} dfdw 

and S 3n (k) is defined by 



^ a iir a j:r (ij) ro (u5 n ) H / / 

~~n JJk 



((1 -v)(l - u^f " 1 ,. 

- |zi> — 



2/3o 



p.!]. 2((r -l)!) a 



ij=0 

J,( r o,ro)(L. U ) 1 TT (ro.ro )(L L \ _ nl.(ro,ro) (L L 



+ 



\(iv-jw)u5 n \ 



1 2ft, 



do{kjuw 

T 



dvdw. 



r-2(ro+ft)) n r 

From the locally stationary condition (14. ip . we get that — S 3n (k) > 0. Con- 

n r + 1 n->oo 
r k=0 

cerning S 2n (k), uniform continuity and boundedness of the function d on [0,T] implies 



<--2(r +fti) 
On 

j._ 4- 1 

fc=0 j=0 



. t~ y~] S 2n (k) < C(r, r ) V" sup sup |d (t + jttw5„) - d (*)| ► 0. 

^r + l r-^ we[o,i] te[o,(n r )5»] n ^°° 
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Finally, since n5 n > T: 



n— ¥00 



r-2(r +/3o) n r 

— Y,S ln (k) >u H £(r,r ,f3 ) 

1 z — * n— >oo 



r k=0 



with 

£(r, r ,Po) 



£ I ((1 - v)(l - w))"- 1 \iv - M 2P ° dvdw) x (I f do{t) at). 

Next by performing elementary but tedious multiple integrations by part and using the 
property X^=i a j,rj p = for p = 1, ... ,r — 1, we arrive at the following simpler form of 
£(r,r ,/3 ) given in ((23]): 

l) ro+1 f Q T d (t)dt " . |2ro+2/3o 



1 ' °' PoJ 2T(2ft + 2r ) • • ■ (2A, + 1) .^'^ 



« - J I 



Case r = 0, r = r + 1 or r = r + 2. The proof is the same but starting from (14. 2[) (with 
I = k) rather than the relation (I4.3p . 

Case r > 1 and r = 1, . . . , r . In this case, r* = r and starting again from the relation ( 14. 3ft . 
one gets 

E(A^ Xf = u 2r y^a^a^ijSlY ( ( (1 " V J - ^(A^, dwiti;. 

^ Mo,i] 2 l^- 1 ) 1 ) 

The result follows from uniform continuity of L^' r - ) , r = 1, . . . , r and the property 
E(lM(i)) 2 = L( r < r )(M). 

4.2. Auxiliary results. The following lemmas give some useful results on the asymptotic 
behaviour of C r {k, i) and C 2 r (k, i) with C r {k, i) = Gov (A$ X, A$ X) . 

Lemma 4.1. Suppose that Assumption A2.1\ is fulfilled and let u be a positive integer, 
(i) Under Assumption A2.2V 1) and for r = r + 1 or r = r + 2, one obtains 



max 

fc=0,...,n 

' £=0 



0(n~ H ) i/0<A,<§, 
£)|C r (M)l = \0{n- H \nn) i//3 = §, 

O(n-( 2ro+1 )) i/± <#,<!; 



and 



]£^C r 2 (M) = <| O Inn) i/ft 

( n -(4ro+2)) z/|</3 <! 



3 
4> 

3 
4' 



fc=0 1=0 
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(it) Under Assumption A2.2V 2) and for r = r + 2, one obtains max |C r (/c,£)| = 

k > . . . .Thy 

0(n~ H ) andJ2Y. C r( k >^ = °{ n ~ 2H+l )- 

k=0 1=0 

(iii)Ifr = l,...,r (withr >l),then max V |C r (fc, t)\ = o(n~ 2r+1 ) ondVV C 2 r (k,£) 

k=0,...,n r ' ^ \ J ' ^ ' ^ 

£=0 k=0 £=0 

o(n~ 4r+2 Y 

Proof. Setting (i(t) = E(X(t)), one has 

r 

C r (k,£) = a i>r a jtr {l^> \k iu ,i ju ) - fi{k iu )fi{£ ]U )}. 

i,j=0 

Similarly to (I4.2p - fl4.3p . we get the expansion 



i,j=0 

for r* = min(r , r) > 1 while if r = 0: 



(4.5) C r (k,£)=^a iir a jtr (u 2 ij6 2 f [ [ (1 5,^,^ ^ '^(kuv, i jwo ) dvdw 



(4.6) C r {k, ?) = ^Y1 <*i,rHMku, tju)- 

i=0 j=0 

(i) Case r > 1, r = r + 1 or r = r + 2 and A |2.2( 1) satisfied. In this case r* = r and we 
have the bound: 

Tip 

max \C r (k,£)\ < U ln (f,r ) + U 2n (r,r ) + U 3n (f,r ) 

k=0,...,n r ' J 
1=0 

k—ur~l n r 

with Ux n (r,r„) = max V] \C r (k,£)\, U 2n (r,r ) = max V] |C r (M)| 

fc=w+l,...,n r ^— -" ' fc=0,....ri— 2ur— 1 ^— * 

£=0 £=fc+ur+l 

min(n r ,fc+wr) 

and U 3n (r,r ) = max V" |C r (A;, f)|- 

k=0,...,n r ' 

^=max(0,fc— Mr) 

First, consider the sum Ui n (f, r )+f/ 2n (r, r ) where |fc — £| > uf+1. We have ^[ =0 ai )r i r ° = 
for r = r + 1 or r = r + 2 and (14. 5p may be written as follows: 



(1 - v) ra - l {\ - w) 



r-o-l 



(4.7) - K^ r °\kj juw ) - K^ ro \k uv J) + K^ r °\k,£)\dvdw 
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and since [k, ki UV ] and [£,£j U w\ are distinct for \k — l\ >ur + 1: 

(1 _ _ w )ro-l 



1!) 



C r (k,£) = a i>r a jjr (u 2 ij6l) 

i,j=0 



ro 



[0,1] 2 



((r - W 



k J£ 



K (ro+1 ' ro+1) (s,t) dsdtdt-dw. 



By this way, the condition A I2.2( 1) gives the bound 
\U ln (r,r ) + U 2n (r,r )\ < dfcrjti* * 



k—ur—l pk+ur6 n fl+ur5 n 



max 

k=ur+l,...,n r 



1=0 



+ max 

k=0,...,n— 2ur- 



=A:+w+l 



(t - s)- 2(1 - /3o) dsdt 



[8 ~ t) 



-2(1-/3, 



o) dsdt ) 



involving, in turn, that 

n 

\U ln (r, r ) + U 2n (f, r ) | < C 2 (r, r )n" H ^ z" 2 ^) 



i=i 



which is of order n~ H if < (3 < |, Inn if (3 = | and 77, _2ro_1 if (3 Q > |. 

Next, for U^ n (f, r ) where |& — £\ < uf, we proceed similarly as in the proof of Proposi- 
tion [2TT1 on basis of the following decomposition derived from (14. 5ft : 



C r (k,£) = -~y\ ai,raj, r [ [ {u 2 ijS 2 n ) 
2 f-^o J J [OA? 



((1 - v)(l - w)) ro 1 



((ro-1)!) 2 



2/3o 



J,( r o,ro)('h. I. \ _i_ J,{ro,ro)(f . p. \ _ 91f,(ro,ro) (I. p. \ 



2/3o 



do(£juw) } dvdw 



1 



2 / j ^i,r^j,r 
i,j=0 



[0,1] 



( y~] a i>r / (uiS n 
V i=o ■ / ° 



((1 -„)(!-«;)) 
((r -l)!) 2 

(1 - „)n>-i 



ro— 1 



2/3 



d (i juw ) dvdw 



{^ r °\k luv )-^\k))dv 



(r - 1)! 

(i - wY - 1 



3=0 



(r - 1)! 



(^\£ juw )-^\£))dw 



The relation (12. ip gives a o(5^) for the first term while one obtains a 0(5^) for the fol- 
lowing ones, using uniform continuity of do and Cauchy-Schwarz inequality. The result is 
U 3n (f,r ) = 0(n~ H ) as n5 n -> T > 0. 
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Concerning Cy(A;, £), the proof is essentially the same and we outline only the main 

k=0 e=o 

n r n r 

steps. We start with E E C *(k, ^ - Vln ( f ' r °) + V ^ r °) + ^ 3 ™^' r °) 

k=0 1=0 

n r k—ur—1 n—2ur—l n r 

where V ln (f,r ) = £ E C 2 (M), V 2n (f, r ) = E J] C 2 (/c, £) and V 3n (r, r ) = 

k=ur+l i=0 k=0 l=k+ur+l 

n r mm(n r ,k+ur) 

E E C r(k, £ )- From (EZD and r = r () + 1, Assumption A I2.2( 1) gives 

k=0 £=ma,x(0, k—ur) 

V ln (r,r ) + V 2n (r,r ) < C[(r, r )6* r °x 

n r k-ur-1 r k+ur8 n pi+urSr, 



EE/ / (t-s)-^dsdt) 

k =ur+l 1=0 KJk Jl ' 

n —2ur —l rir i>k+ur8 n pt+ur5 n 2 

+ E E ( / / (s-ty^-^dsdt ' 



k=0 £=k+ur+l 



k J I 



implying in turn that Vi n (r,r ) + V2 n (r, r ) < C' 2 {r,r )n 2H+l 4( - 1 which is of order 

i=l 

n -2H+i if < /3 < |, n~ 2H+l Inn if f3 = f and n _4r °- 2 if /3 > §. Next, from f l4~5j) . one may 
deduce that V 3n (f,r ) = C(n" 2H+1 ). 

(i, followed) Case r = 0, r = r + 1 or r = r + 2 and A I2.2( 1) satisfied. Both results are 
obtained by starting from f 14 . 6 [) rather than (14. 5p . 

(ii) Case where r > 1, r = r + 2 and A I2.2( 2) holds. The single difference occurs for 
terms U ln (resp. V\ n ) and U 2n (resp. V 2n )- Since r = r + 2 and ^[=i 2 ro+1 cv +2 = 
0, one may add or subtract quantities as iuv5 n ¥S ro+1,rCl \k,lj UW ), iuv5 n ¥S ro+1,ra \k,£) or 
iju 2 vw 5 2 K( ro+1 ' ro+1 \k,£) without changing the result of (l4"77jl . Thus, 



C r (k,£) = E ^^+2^0+2 (« 2 U^) r ° / / 



(i - w) r °- 1 (i - wf ' 1 



[o,iv (K-l)!) 2 



x 



k Jl JkJt 



ft K( ro+2 ' ro+2 )(y,^) dydzdsdtdvdw. 

JkJi 



By this way, the condition A I2.2( 2) gives the bound 
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\U ln (f,r ) + U 2n (r,r )\ < C 3 (f,r )5 2 n r °x 

k-ur-1 r k+ur5 n r l+urS n r t 



( ~ ~ rk+urd n i>e+urd n rt rs 

yiy rk+ur5 n r£+urS n rt rs \ 

V / / I (y-zr^dydzdsdt) 



max 

fc=0,...,n— 2ur- 



so that |f/ ln (r,r ) + U 2n (r,r )\ < C 4 (r,r )n~ H J2*~ 2{2 ~ M = 0(n~ H ), for all O e}0, 1[. On 
the other hand, one obtains that 

\V ln (r,r ) + V 2n (r,r )\ < C' A (f,r ) n - 2H+1 Y,^ i2 ~ M = 0{n~ 2H+1 ). 

i=l 

(ii, followed) Case r = 0, r = r + 2 and A I2.2( 2) satisfied. The same methodology applies 
starting from (14. 6 P rather than ( I4.5p . 

(iii) Case r = 1, . . . , r (with r > 1). The expansion (I4.5P becomes 

G r (k, t)=Y j a ir a jr [ [ {iju 2 5 2 n ) r i{1 ~,^ 2 ))r 4«0 d^du> 

and both results follow from uniform continuity of K^ r ' r ^ since r < r . 

□ 

The next proposition gives general exponential bounds, involved in the proofs of our main 
results. 

Proposition 4.1. Suppose that Assumption A2.1\ is fulfilled, letr) n (r) be some given positive 
sequence and u E N* . 

(i) For r = r + 1 or r = r + 2 and if Assumption A2.2\( l ) is satisfied, one obtains for 

(4.8) MM = «%,§[(&) + n H (lnn)l { i } (/3 ) + n H+2 ^H ]U[ (f3 ) 

+ n^-^lnn)- 1 ^^) + n 2r ° +2 t ]ll{ ((3 ), 

(4.9) <p ln (p ) = / +1 l 10 i[(A) + n H+1 {\nn)-H {h} {P ) + n 2 ^ +1 H ]hl[ (/3 ) , 

(4.10) ^ 2n (/3 ) = n 2H+1 t ]0 ^ ) + n 2H+1 (lnn)^l {|} (/3 ) + n^ 0+1 h ]hl[ ((3 ) 
and the conditions ip n {Po)Vn{ r ) 0, 

(4.11) p(|(AFxj^-E((AFxj^)| >r) n (rj) = o(exp(-D 1 (r)tp 2n ((3 ) V 2 n (i 
while for rj n {r) such that V ; n(/3o) ? ?n( r ') _ > C G]0, +oo]: 



(4.12) p(|(A^X) 2 -e((A^X) 2 )| >r/ n (r)) = exp ( - D 2 (r) ^ )^(r)) J . 
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(ii) For r = r + 2 and if Assumption A2.2Y 2) holds, the condition n H r] n (r) — > implies 
(4.13) p(|(AF^-E((AFrp)| >r/n(r)) = ^(exp ( - D 3 (r) n 2H+1 V 2 n (r)j 
while if n H rj n {r) — > ( e]0, oo]: 
(4.14) 



P 



(A^X) 2 -e((A1 m) X) 2 )| >r/ n (r)) =(9(exp(- J D 4 (r)^ + VW) 
(Hi) If r = 1, . . . ,r (with r > 1) and n 2r f] n (r) — > oo: 

(4.15) p(|(A^ } X)2-e((A^X) 2 )| >77n(r)) = O^exp ( - D 5 (r)n 2r Vn (r)) 

where -Dj(r) 's are positive constants not depending on n and r) n (r). 
Proof. For all r > 1, we may write 

(4.16) p(|(A1 u) X)2-e((A(: 1i) X) 2 )| >7j n (r)) <s 1 + s 2 
>^ X - E(A$ X)) 2 - Var (A$ X) > K + ^ 

fc=0 



with 5i = P ( 



and 



& = P 



^(E(A;jx))(Agj-E(A«X)) 



» 



fc=0 



> 



(ry + l)r] n (r] 
4 



First, let {Yi}i=i,...,d n be an orthonormal basis for the linear span of {A^2 X}k=o,...,n r ( so 
that Yi are i.i.d. with density 7V(0, 1)). We can write 

Ag ^ - E(A$ X) = £ Gov (A$ X, y)y := £ 6^ . 

i=l i=l 

Next, if y = (Yi, . . . , yj T , we obtain 

Thy 1 ^77. Tlf dfi 

£(Ag X - EAg X) 2 = £ cyy^ = y T Cy and £ Var (A$ X) = £ c M 



fc=0 



fc=0 



n r +l 



with qj = y2b k ib kj so that for C = (qj) i= i,..., dn and 5 = (ofc,j) fe =o,...,n r +i, one gets 

~ _ 7 = 1, .7=1... ..dn 



fc = 



C = B T B where C is a real, symmetric and positive semidefinite matrix. There exists 
an orthogonal matrix P such that diag(Ai, . . . , Xd n ) = P T CP, for Aj eigenvalues of C Then 

we can transform the quadratic form as: ^^(A^X — E(A^X)) 2 = ^^Aj(P T y) 2 where 



fc=0 



i=l 



(P T y)i denotes the i-th component of the (d n x 1) vector P T Y. Since Y2i=i Cii = Yli=i ^ 



££l Var (Ag X), we arrive at & = P ( | ^ A, ((P T V) 2 - 1) 

i=l 



> 



(n r + l)?7 n (r) 



. Now, with 
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the exponential bound of lHanson and Wrightl (119711 ). we obtain for some generic constant c: 

S, < 2expf-cK + l) Vn (r) x min(^— , ^ + ^ r M 
V Vmax(Ai) E A ; J J 

Next, since B T B and BB T have the same non zero eigenvalues, we write 

Ur+l 

max Aj < max V |e(A^ X - E(A^ X)) (A™ X - E(A^ } X)) 

i=l,...,d n 0<fc<n r +l ^ I V r ' ft V T ' fe r > £ V r ' £ " 

£=0 

< max V|C r (M)| 

£=0 

with C r (fc, £) = Cov (A^ } X, Aj$ X) . Moreover 

d n d n d n n r +l n r +l d n n r +l n r +l 



i=i 



i=i j=i 



fc=0 £=0 i=l 



fc=0 £=0 



Finally 
(4.17) 



Sl < 2exp(-cK + lK(r) x min(( max + JT j C r (k,i)\ )~\ J^^* )) 

fc=0 £=0 

For the term S 2 i n (14.161) . we employ the following exponential bound with Y ~ A/"(0, o" 2 ), 
o- > 0: for all £ > 0, 



P(|r| >e) <min(l,;/— ) x exp(-— ). 



2a 2 



tie" 



We set Y = EL ( E ( A S X )) ( A 3 X ~ E ( A S X )) and £ = (^j^W- We obtain that 
Var (Y ) < u n (r) with 

(4.18) Vn {r):=n max (E(A^X)) 2 max V|C r (M)| 



so that 



(4.19) 



4y^H , ^ K + l) 2 ^(r) 
S 2 < mm (1, v — — — j exp ' 



a/tt^,. + l)r) n {r)- 



32v n (r) 
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Finally collecting the results (I4.16p - fl4.19p . we obtain: 
(4.20) 



P( (A^Xy-EfiA^Xy) >r /n (r))=ofmin(l,^^)exp(-C(r)^^ 
V V J J \ v nr] n (r) ' \ v n (r) 

+ 0[ exp( — C(r)nrj n (r) x min( ( max | C r (k,£)\ ) 

V V \ 0<fc<n r +l ^— 



nr] n {r) 

' n r +l 
fc,£=0 



for some positive constant C(r), not depending on n nor t] n {r). Now from (I4.20p and 
Lemma 14. 1[ one may deduce all exponential bounds claimed in f l4.lip - p.15p . 

(i) Case r = r + 1 or r = r + 2 and A I2.2( 1) holds. First, for r = r + 1 or r = r + 2, 
and since is (r + l)-times continuously differentiable, a Taylor decomposition of order 
r + 1 (similarly to the derivation of (jO)) ) gives E(Aj$ X) = O(n" (ro+1) ). Next, from pg| 
and Lemma l4~lT i). one obtains v n (r) = 0(n~ T0 ipi n (f3 )) with ipi n (/3 ) given by the relation 
f)4.9p . implying in turn that S 2 = (9(exp(— C{r 

)n 2 ( ro+1 Vin(/3o))^n(^))- Moreover, for Vn(A>) 

defined in (H~g]) and i/; n ({3 )r) n (r) -> 0, we have : Si = C^exp( - C(r)ip 2n ((3 )r]l(r))^ 

for, again, some generic positive constant C(r) and with (p 2n ((3 ) given by (I4.10p . As a 
consequence, one gets that S 2 = o(Si) for all j3 e]0, |] while S2 = O(iSi) for /3 e]|, 1[ (this 
last case is of no interest since exponentials don't converge toward 0). 

On the other hand, if V'n(/9o) ? 7n( r ) — > C s]0, +00], one gets the claimed bound from (I4.20p 

since S 2 is the worst of the same order as Si = Of^exp ( — C(r)(pi n (/3 )T) n (r))J. 

(ii) Case r = r + 2 and Assumption A I2.2( 2) holds. In this case, Lemma I4.1( ii) implies that 
Vn (r) = o(n- {iro+2 P° +1) ) for all ft g]0,1[, and if ip n {(3 )Vn{r) -> 0, S 2 is again negligible 

toward Si = O^exp ( — C(r)n 2H+1 r] 2 (r)^ J . The same conclusion holds for ip n (P )Vn{f) — > 
C G]0, +00], since the bound (14201) results in 5i = £>f exp ( - C(r)n H+1 r] n (r))j . 

(iii) Case r = 1, . . . , r (r > 1). For this case, we have E(A^ X) = 0(n~ r ) and, Lemma l4TTT iii) 

n r +l 

implies that max V |C r (M)l = C(n" 2r+1 ). We get that v n {r) = C(n" 4r+2 ) and 

0<fc<n r +l ' J 

Si = O^exp ( — C(r)n 2r r) n (r)) J . Next, the condition n 2r r] n (r) — > 00 implies 



P( |(Al n) X) 2 - E( (A^X) 2 ) J > Vn (ri 

= 0(^-^y exp ( - C(r)n* r V 2 n (r))) + o(exp(-C(r)n 2 ^ n (r))) . 

and the first term is again negligible. □ 



4.3. Proof of Theorem [HH 
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Proof. Recall that f~ , defined by equation (I2.5p . is given by: 

f~ = min <r E {2, . . . , m n } : B n (r) holds > — 2 



where the event B n (r) is defined by B n (r) = {n 2r - 2 (A^X) 2 >b n }. 

First remark that m n — > oo guarantees that for n large enough, r + 2 G {2, . 
From the definition of r , we write 

m n -2 

E(f - r ) 2 = J2 ( r ~ r o) 2 ^(f = r) + {l - r ) 2 F(f = l ) 

r=0 

and 

P(r o = 0) =P(S n (2)) ifr = 0, 

F(f = r) =P(S«(2)n---nS»(r+l)nS„(r + 2)) if r = l,...,m n 
P(r = Z„) <P(^(r + 2)). 

Next, setting 1 ■ ■ • = Xli" 1 ■ ■ ■ — ■ ■ • = 0, we have for all r e ]N : 

r -l 

E(r - r ) 2 = r 2 P(5 n (2)) + j^(r - r ) 2 P(^(2) D ■ • • fl ££(r + 1) n £ n (r + 2)) 

r=l 

m„-2 

+ ^ (r - r ) 2 P(^(2) n ■ ■ • n £T(r + 1) n B n (r + 2)) 

r=ro+l 
+ (/ -r ) 2 P(r = / ) 

ro-l m m — 2 

<£(r-r ) 2 P(B n (r + 2))+P(B°(r + 2))( £ (r - r ) 2 + (/ - 

r=0 r=ro+l 
ro-l 

< r 2 £ P(5 n (r + 2)) + o(P(B£(r + 2))m») 

= O(T ln (r ))+O(m3T 2n (r )) 
where we have set T ln (0) = and 

r +l 

(4.21) T ln (r ) = ^ P(a n (r)), for r > 1 

r=2 

(4.22) T 2n (r ) = P(^(r + 2)). 

Now, the study of terms T ln and T 2n may be derived from Proposition 14.11 

Term 7i n (r ) (when r > 1). 
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If T\ := r + 1 and ■ • • = 0, we have 



ro 

T ln (r ) = ^P((A1 1} X) 2 > b n n 2 ~ 2r ) + p((A^X) 2 > b n n~ 2r ° 



r=2 
ro 



^p((Al 1} X) 2 - E(A^X) 2 > b n n 2 - 2r - E(A^X) 2 ) 



r=2 



P^A^X) 2 - E(A^X) 2 > b n n~ 2r ° - E(A^X) 2 ) 



For r = 2, . . . , r (r > 2) and r/ n (r) = b n n 2 ~ 2r — E^A^X) 2 , one obtains n 2r r] n (r) ~ 6„n 2 — > 
oo by relation (12. 4p of Proposition [27TT ii) . We make use of the bound (14.151) of Proposition |4~T1 
to obtain that the first term is of order (9(exp(— D{r ) 6 n n 2 )). For the second term, we set 

Vn(r ) = b n n~ 2ro - E(Al 1 1 ) X) 2 . Proposition [OW implies that ^ n (l3 )Vn{r ) > b n ^ 



oo for all /3 g]0, 1[, which gives, help to the exponential bound established in (I4.12p . a 

for this term. To conclude, 



n 2 



O(exp(-D(r )64^ +1 l ]0ii[ (/3 ) + — l {|} (/3 )+n 2 l ]il[ (/3 )) 
we obtain that : 



n 2 



T ln (r ) = 0{ exp ( - D{r )b n {n 2 ^ +1 t ]0 + (-— )Wfl,) + ™ 2 % 1[ (P )) 



dnn ; 

Term T 2n (r ). We have for r 2 = r a + 2: 



T 2n (r ) = p((A«l) 2 <fe nn - & - 2, 

= P(E( (A«X) 2 ) - (A«X) 2 > E( (A«X) 2 ) - 6, 



If we set r/„(r ) = E^ (A^X) 2 j — 6 n n 2r ° 2 , the condition 6„n 2/3 ° 2 — > and Proposi- 
tion O^i) imply that ip n ({3 )r] n (r ) > n H r] n (r ) T H £(r 2 ,r , (3 ) > with £{r 2 ,r ,(3 ) given 
in relation (12. 3p . For some positive generic constant D(r a ) not depending on n, Proposi- 
tion HJ] with the bound (I4.12p gives, if Assumption A I2.2T 1) holds: 



T 2n (r ) = O^exp ( - D(r )(nt ]0 ^ ) + (JL)l { i } (fl,) + n* 1 "*^^))) j , 
while if Assumption A I2.2( 2) holds, the bound (I4.14p results in: 

T 2n (r ) = o(exp(-£>(r )n 



for all f3 g]0, 1[. For p = 1,2, we get that T ln (r ) = o(T 2n (r )) and the claimed result 
follows. □ 



4.4. Proof of Theorem [Ml 
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Proof. We start the proof with, either p = 1 or p = 2, and thus denote by r v (resp. r p ) the 
quantity f~ + p (resp. r + p). For some > r p , we set 

(4.23) l n (P ,r ,p) = _ it V V ai,r p a iirp (zj) ro 

2( n _ Mrp + i) ^ 

x // 1(1 1 ~ W)T °" 1 |^-jwr o rfo((fc + j^n)dr;d W , 

ii[o,i] 2 (r,,-l)! 2 

for all r > 1. In the case where r = 0, we set 

(4.24) l n (&,0,p) = -- — — — - £ £ Gi , rp a, rp |< - j| 2 * do(^). 

^ p ' k=0 i,j=0 

For some r p > Vp, we consider the following decomposition : 

n—ufp 

Hu/v)H^ = In ( K^U) 2 - (uT) H l n (/3 ,r ,p) + (uT) H l n (/3 ,r ,p)) 

n - ur p + 1 ^ 

-ln( %z— (^ k X) 2 -(vT) H l n (P ,r ,p) + (vT) H l n (^r ,p)) 

n - vr p + 1 ^ 

Hence 

(4.25) ln(u/i;)(#W - #) = F n (u) - F n (v) + o(F n (u) + F») 
with 

F n («) 



n H (A^X) 2 - {vT)*lM,r ,p) _ F hn>p (u) + F w («) + F s>fllP («) 



(uT) H l n ((3 , r ,p) (uT) H l n (/3 , r„, p) 



where F 1>n » = ((A^X) 2 - (A^X fc ) 2 ) , F 2 , n » = W (a£?X) 2 -e( (A^X) 
and F 3 , n » = r^E((A^X) 2 ) - (uT) H l n ((3 , r ,p). 

(i) Study of Fi np {u). We show in this part that, almost surely for n large enough, 
F\, n ,p{ u ) = for p = 1,2 (as a consequence of = r , a.s. for n large enough). For 
this, we proceed similarly as in iBlanke and Vial and as previously, we set 



B n {r) = {n 2r - 2 {ti l) X) 2 >b n ). 

First, we have 

'{f = 0} = £? n (2) ifr o = 0, 

% {r = r } = B c n {2) n ■ • • D B c n (r + 1) n 5 n (r + 2) if r > 1 

so that 

'{fo^r } = ££(2) if r () = 

{P ^ r } = B n (2) U • • • U £ n (r + 1) U S°(r + 2) if r > 1. 
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Then, for all r > and n large enough: P(fJJ 7^ r ) < T ln (r ) + T 2n (r ) with T ln (r ) and 
T2n( r o) defined in (I4.2ip - fl4.22p . We have shown that T ln = o(T 2n (r )) and T 2n (r ) has an 
exponential decreasing. This implies that P(f£j 7^ r ) < 00, so, almost surely for n large 
enough, = r . As a consequence: 



(4.26) Fi,nM = 
for p = 1 or p = 2, a.s. for n large enough. 

(ii) Study of F^^^u). We apply directly Proposition 14.11 with p = 1 or p = 2. For 

p = 1, we have: p(|F 2in ,i(u)| > ej = p( (A^ l) X) 2 - e( (A^X) 2 ^ > n~ H e}. Next, for 
r] n = n- H ei n ((3 ) where 

/In n\! , n . /\nn\ / Inn \ 

e := e ln (/3 ) = e [—) l ]0l f[(fl>) + ^0 J l { | } (/3 ) + ^(^z^y J 1]| ,i[(fl>), 

e > 0, we get that Vn(A>)f/n ->■ for & e] 0,f[, ip n (Po)Vn -> C > if A, = f while 
ipniPojVn -> 00 for /3 G]|, 1[. From f l4.lip - fl4.12p . we may deduce that for all /3 e]0, 1[, 

p(|F 2 , n ,i(u)| >£i„(/3 )) =0(exp(- J Di(n)eglnn)) 
which gives, for e chosen large enough, T^P( |-^2,n,i(w)| > £in(/3 )) < +00 so that, almost 

n 

surely, 

(4.27) limsupe^Oflo) I^WHI < +00. 



For p = 2, one may apply the bound (I4.13P with e 2n = e ( ) to get the same result 

for all j3 G]0, 1[ and e large enough: almost surely, 



(4.28) limsupe^ 1 \F 2 ^ 2 {u)\ < +00. 
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(iii) Study of F 3 ^ p (u). From (I4.3[) and proceeding similarly as in (14.40 in the case r > 1, 
we get 



n 11 



e( (a^x) 2 ) ~ t h s~ h e[ (a^x) 2 



/ff e ^! // ( (1 -; )(1 -;f" 1 L(^)(iL B ,^)dt;du, 
fc£ ^ n-nr p + l y7 [0)1]2 ((r -l)!) 2 

^ ^ 2(n-«r p + 1) JJ[o,i]2 ((r -l)!) 2 



x |zt> — JW 



k=0 i,j=0 

f I,( r O,ro)(L. L. \ i j(r ,r ) ( L . L . \ _ OJ ,(ro,r ) (L. L. \ 



k- — k ■ 



2/3o 



do(k juw ) \ dvdw 



with l n ((3 ,r ,p) given by ( 14.230 . Next, we introduce condition (12.60 by adding and subtract- 
ing the function di: 



E( (A r lW) 2 ) - (uT) H l n (p ,r ,p)\ 



2 



^ ^ (n - ur p + 1) JJ [0)1]2 ((r - 1)!) 



x 



k- — k ■ 

{uT)H+Pl ^ * WirM"* ff ((! - - ^)) r °~ 1 



di(k juw ) > dvdw 



— JW 



2/3 +/3i 



2 ^ 5^,(n-«^+i)yyid,ip (K-i)O 2 

di(kj UW ) dvdw. 

The condition (12.61) implies the convergence of the inner braces to (uniformly in v, w, k), 
so for p = 1 or p = 2, the uniform continuity of function d\ gives: 

(uT) H+Pl J-^ 

(4.29) n^F 3 ,„, p (n) > V a ijrp a jjrp (ij) r ° 

i,j=0 

x ff ((1 ~" )(1 :^ ) 2 r °" 1 i^-^i Wi ( i / T rfl (t)dt). 

ii[0,l] 2 (( r o-l)0 ^io 

Finally, the case r = is treated similarly, starting from ( 14.20 instead of (14.30 . 
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Conclusion. To conclude, one may note that the denominator term, l n (/3 , r ,p), defined in 
fl4.23p - fl4.24p . converges to the nonzero term: 



1 rp 

Wo,r ,p) ► -- V a LTv a^ rp {i]) ra 



' x // (i-^-d - u,)-' ]iv _ «, Avd i r Mt) it 

J J [o,i)» {r -ly/ T J 

for r > 1 while if r = 0, l n ((3 , r ,p) ► -- V] a i>r p a jjr |z - j| 2A) — / d (t) dt. 

Relation ( H~25l) and expressions established in (14 .261) - ( T4 . 2 9 [) lead to the final result. 

□ 

4.5. Proof of Theorem SHI 

Proof. First, we set r = max(f , 1) and, for f~ and X r (-) respectively defined in (J275]) and 
(13.11) . we adopt the simpler convention that f~ — lo =>• Xf (-) = X mn _i(-) and X^ 0+ i(-) = 
X mn {-). Also, we will make use of the following lemma: 

Lemma 4.2. For any Gaussian variable Y , E(F 4 ) < 3(E(F 2 )) . 

4.5.1. Study of e^(app(r^)) . We may write 

(X(t) - x r ~(t)) 2 = (X{t) - X r ~ (t)) Vo-} + (x(t) - X r ~ (t)) 2 t {ro=lo} 

r=0 
m„— 2 

= (^W-^W) 2 lW=r}+(^W-^m»-l(0) a l{«=lo} 
r=0 

where r = max(r, 1) and for = max(r , 1), 

m n — 1 

(X(t) - A^(t)) 2 < (X(t) - X^it)) 2 + l {r ^ ro} ]T (X(t) - X ¥ (t)) 2 

Using Cauchy-Schwarz inequality: 

ej(app(r )) < / T E(X(t)-X r;r (t)) 2 p(t)dt 
Jo 

i m„-l „T _ l 

+ (P(r ^r ))^ Yl I (HX(t)-X ¥ (t))y P (t)dt 
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turning to, by lemma 14.21 

ej(app(f ))< sup (E(X(t)-X w (t)) 2 ) / T p(t)dt 
te[o,T] v J Jo 

+ v / 3(P(f ^r )) 5 V sup (E(X(t)-X T (t)) 2 ) / p(t)dt. 

r=0 ^ ro te[o,T] V /Jo 

Study of the term sup (E(X(i) — X r (t)) J, r = 1, . . . , m n . We have 

sup fE(X(t) - X r (t)) 2 ) = max sup (E(X(t) - X r (t)) ; 
te[o,T] ^ ' fe=o,-,L7J- 1 *e2:fc ^ 



First, suppose that r > 1. We use the decomposition established in iBlanke and Viall (12008 
lemma 4.1) to obtain, for t G Ik and r* = min(r, r ): 

E(x(t) - x r ( t )) 2 = LiArm^t) { 'f} ] m2 If ((i - v)(i - W )f - 1 

x j]L (rV * ) (&x5 n + (t - kr5 n )v, kr5 n + (t - kr5 n )w) - lI- T *' r *\kr5 n + (t- kr5 n )v, kr5 n + j5 n w) 

w) + ,r •* (kr5 n + i5 n v, kr5 n + jS n w) | dt>du>. 
For r = 1, . . . , r — 1, (r > 2), we get that 

tj=0 



E(X(t) - X r (t)) 2 = £ L^L^t) w " / / ((1 - v)(l - w)Y 

[(r - 1)1) JJ[o,i]2 



r-l 



rkrS n + (t—krS n )v /"fcr<5 n +(t— fcr<S n )«; 

/ / L (r+1 ' r+1) (s,t)dsdt. 

J kr8„+iS„v J krSn+iS 



' fcr^n+z^t? J kr8 n -\-jS 

As L( r+1 ' r+1 )(-,-) is continuous, we obtain the bound: E(X(t) - X r (t)) 2 = C(^ r+2 ). For 
r = r , . . . , m n , we arrive at 



E(X(t) - X r (t)) 2 = £ W*)W*) J'^I / ((1 - «)(1 - «;)) 

nr'n (( r o - 1)0 7ro,n 2 



ML/ ^ „ W1 „..^ -i 

(^-l)!) 2 ^ 

x I L (ro ' ro) ( £;r<5 n + (t - Ax5,>, A;r5 n + (t - fcr5 n )w) - L (r °- ro) (kr6 n + (t - krd n )v, krd n + j6 n w) 
- E^ r °\kr5 n + i5 n v, kr6 n + (t - kr6 n )w) + L {r °' ro) (kr6 n + i6 n v, krd n + j5 n w)\ dvdw. 



Adding and subtracting terms like ^lS r ° ,ro \kr8 n + (t — krS n )v, krS n + (t — krS n )v) and 
l^ ro ' ro \kr8 n +(t-kr6 n )w, kr5 n +(t-kr5 n )w), or \E^ r °\kr5 n +[t-kr5 n )v, kr5 n +(t-kr5 n )v) 
and ^h^ r °' r °\krS n +jS n v, kr5 n +j5 n v), we make use four times of the Holderian regularity 
condition ( 14.1 ft to obtain, using the bound L^k jT {t) < r r , that 

- for r = r , sup E(X(t) - X w (t)) 2 = (#*>+*>), 
te[o,T] 
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- for r = r + 1, . . . , m n , sup E(X(t) - X ¥ {t)) 2 = O(m 2 n ^ +r0+ ^5 2 n {r ° +M ). 

te[o,T] 

Next, for r = 0, we observe that above results hold true starting from 

r 

E(X(t)-X T (t)) 2 = E L lA r(t)L jA7 (t){l(t,t) - L(t,k?8 n + j8 n ) 

i,j=0 

- L(kr8 n + iS n , t) + L(kr5 n + iS n , kfS n + jS n ) 



Collec ting these result, and using the exponential upper bound established in lBlanke and Vial 



(120111 ) for P(/\, 7^ r ), we arrive at the final result, help to the logarithmic order of m n . 



4.5.2. Study of e 2 p (mt(f )) . Since /„ (X(t) - X r+1 )p(t) dt is again a Gaussian variable, in a 
similar way as for approximation, we get the bound: 

I 1-1 I -2-1-1 

eJ(int(fo))< E E / / E(X(t)-X ro+1 (t))(X(s)-X ro+1 (s))p(t)p(s)dsdt 

k=0 £=0 

+ v / 3(P(r-^r ))^ E ( sup (E(X(t)-X r+1 (t)) 2 ) 3 ) ( / p(t) dt) 2 . 



r=0,r^ro 



Study of the term E(X(t) -X rn ^ (t)) (X(s) - X ro+1 (s)) , (s,t) e X t xX k . A gain from lemma 



4.1 of iBlanke and Viall ( 120081 ). we get 



E(X(t) - X ro+1 (t)) (X(s) - X ro+1 (s)) 



r °± 1 (inPYo rr 

= g L *.wft)^ + i(^) (( ^_i )!)2 yy o a a (a - «)(i - tii))**- 1 

z,j [ ' ] 

x {l>> r °)(A;(r + l)5 n + (t - fc(r + l)<f„)M(r + l)8 n + (t - £(r + l)5 n )w) 

- L^ r °\k(r + l)8 n + {t- k(r + l)8 n )v,£(r + l)8 n + j8 n w) 

- l^ r °\k(r + l)8 n + i8 n v, £(r + l)8 n + (t- £(r a + l)5 n )w) 

+ I>°- r °)(fc(r + l)(J n + z<W(r + l)5 n + j6 n v)} 

For non-overlapping intervals andX^, that is |fc — Z| > 2, we make use of Condition A I2.2( 2) 
four times, by adding and subtracting the necessary terms, noting that 

ro+l 

E L i)k , ro+1 (t)L jAro+1 (s){i6 n ) ri (j6 n ) r * = {t- k(r + l)8 n ) r ^s - l{r + l)5 n ) r * 

i,j=0 
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with either = r or r» = r + 1 for i = 1,2. By this way, we get 
E / / E(X(0-X ro+1 (t))(X( S )-X ro+1 ( S ))p(f)p( S )d S df 



k,«=0 

|fc-£|>2 



I " 1-1 

0^y2(ro+fl>+l) ^ \\k-£\- l\~ 2 P~P°A = O (nC^ (ro+/3 ° +1) ) = ^(n>+A>)+l\ 



M=0 

|&-£|>2 



For overlapping intervals and Xf, that is |/c — 1\ < 1, we make use of Cauchy-Schwarz in- 
equality to obtain the same bound as above. Since the second part of e^(int (r^)) is negligible, 
we obtain the claimed result. □ 
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